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Stochastic thermodynamics is formulated for variables that are odd under time reversal. The 
invariance under spatial rotation of the collision rates due to the isotropy of the heat bath is shown 
to be a crucial ingredient. An alternative detailed fluctuation theorem is derived, expressed solely 
in terms of forward statistics. It is illustrated for a linear kinetic equation with kangaroo rates. 
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The second law of thermodynamics is arguably one 
of the most general laws of nature. While originally 
stipulating the increase of total entropy in a closed iso¬ 
lated system A Stot > 0, it was reformulated by split¬ 
ting the entropy change AS of an open system into the 
sum AS = AiS + A e S of a non-negative entropy pro¬ 
duction term A^S > 0 plus an entropy exchange contri¬ 
bution A e S. In particular when in contact with a sin¬ 
gle heat bath at temperature T, the exchange is given 
by A e S = Q/T, where Q is the amount of heat into 
the system. Over the past two decades, a much deeper 
formulation of the second law has been achieved by fo¬ 
cusing on small open systems. One can still define all 
the above mentioned quantities, but they will now fluc¬ 
tuate from one measurement to another. Using lower 
case to distinguish the values from the non-fluctuating 
macroscopic counterparts, one has As = A;s + A e s, 
with A e s = q/T. The second law is replaced by a 
symmetry property for the probability density P(Ais) 
to observe an entropy production AjS. In its simplest 
form, the so-called fluctuation theorem states that the 
probability for observing an entropy increase is exponen¬ 
tially larger than that for observing a corresponding de¬ 
crease, P(Ajs) = exp(Ais)P(—Ajs). The second law 
(A is) > 0 follows as a subsidiary result. The fluctua¬ 
tion theorem has been obtained at different levels of de¬ 
scription, ranging from the microscopic laws mm , over 
thermostated systems mm to stochastic dynamics B 
[7J- “Stochastic thermodynamics” is easy to formulate in 


the context of a Markovian description, both at the level 
of a Langevin/Fokker-Planck equation or the more gen¬ 
eral Master equation HHEE], and its predictions have by 
now been confirmed by numerous experiments. The focus 
has been mostly on overdamped systems with variables 
that are even under time-reversal. However, for variables, 
such as velocities instead of positions, it was claimed that 
the theory becomes more involved and hence loses some 
of its appeal mug. In this Letter, we show that this is 
not the case if the transition probabilities obey, in addi¬ 
tion to detailed balance, a symmetry property, reflecting 
the isotropy of the heat bath. To demonstrate the role 
and importance of this condition, we develop the stochas¬ 
tic thermodynamics, both at the ensemble and trajectory 
level, for linear kinetic equations, a field that has not been 
explored before and for which there is a large potential 
interest. We derive the fluctuation theorem, including 
a new version expressed only in terms of probabilities 
computed from the forward process. As a application, 
we provide explicit illustrations for the special case of 
kinetic “kangaroo” equations M- 

We consider the simplest scenario of a system consist¬ 
ing of a single stochastic Maxwell-Lorentz particle, cf. 
da ns] for a detailed analysis of a similar model, with 
mass m, velocity v at position x in the constant external 
force field F (acceleration a = F/m ), and in contact with 
a single isotropic heat reservoir at rest with temperature 
T. The stochastic dynamics of the particle is character¬ 
ized by a probability density P(x, v: t), obeying the linear 
kinetic equation: 


' d d 8 ' 

dt +V di +a Wv 


P(x,v,t) 


j dv' [k(v' -A v)P(x , v'\ t) — k(v -A v')P(x, v, t)]. 


(1) 


Here k{v 1 -A v) is the transition probability per unit time 
(rate) for a change of velocity from v' to v. Formulation 
of the first law at the trajectory level is straightforward. 


The energy e(t) of a particle in the constant external 
force field F is: 

e(t) = — Fx(t) + ^ mv 2 (t ), 


( 2 ) 
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where x(t) and v(t) are the position and velocity of the 
particle at time t in the given realization. The “ensem¬ 
ble” version of the first law is obtained by averaging with 
respect to the probability density P(x,v;t ): 

E{t) = (e{t)) = -F(x{t)) + \m(v\t)). (3) 

In-between collisions, potential energy is converted into 
kinetic energy following Newton’s law mv(t) = F, 
hence this non-dissipative process produces no net en¬ 
ergy e(t) = 0, and neither work nor heat are exchanged. 
The punctual collisions with the heat bath however lead 
to an instantaneous exchange of energy under the form 
of heat: 


e{t) = q(t), (4) 

with q(t) a sum of delta functions at the instants of the 
collision and with amplitude 1 m(v 2 — v' ) for a collision 
changing the velocity from v' to v. At the ensemble level, 
the resulting heat flux Q(t ) is obtained by averaging over 
the frequency of such collisions: 

E(t) = Q(t ) = JJ dvdv'k(v' —> v)P(v' ,t)Jn(v 2 — v' 2 ). 

(5) 

We next turn to the second law and formulate it first 
at the ensemble level. The “ensemble” entropy associ¬ 
ated to the distribution P(x,v;t ) is given by S(t) = 
—k B f dxdvP(x, v; t) In P(x, v; t), with k B Boltzmann’s 
constant. When considering the time derivative of this 
quantity, we note that the motion is purely Hamiltonian 
in-between collisions. Following Liouville’s theorem, this 
part of the dynamics leaves the entropy invariant m- 
Hence, we need only to focus on the change of the entropy 
induced by the dissipative collisions, affecting solely the 
velocity variables. From: 

S(t) = —ks f dv P{v, t) In P(v, t) (6) 


we find in combination with the evolution equation for 
P(v,t), obtained from Eq. and following some simple 
manipulations, that the rate of change of the entropy is 
given by: 

S — k B [[ dv dv'kiv' —> v)P(v', t) In— - —A. (7) 

JJ P(v,t) 

This rate of entropy change can thus be rewritten under 
the standard form S = Si + S e with the rates of “entropy 
production” and “entropy exchange” given by: 


A 

k B 

A 

k B 


= [[ dvdv'k(v' v)P(„', t) In > 0, 

JJ V V 7 k(v ->■ v')P{v,i) ~ 

= ff dvdv'k{v' —> v)P(v ', t) In A A ~ , ■ (8) 

JJ k(v' -5> v) 


These results are mathematically exact but, in order 
to achieve a correct thermodynamic interpretation of the 


entropy production and exchange, one needs in addition 
proper physical input about the collision mechanism, i.e. 
about the collision rate. We focus here on the simplest 
case in which the collision process represents energy ex¬ 
change with a single isotropic thermal reservoir at tem¬ 
perature T. As a result the collision process must in¬ 
duce, in absence of an external force, a relaxation to the 
Maxwell-Boltzmann distribution ip o, i.e., one has: 

J dv'k(v —> v')(po{v) = J dv'k(v' —► v)po(v'), (9) 


with po(v) = 


„-v 2 /2a 2 

o\[2t; 


a 1 = rnksT. 


( 10 ) 


As was realised first by Onsager mi, micro-reversibility 
leads to a more stringent condition of detailed balance: 


k(i 


v’)ip 0 (v) = k(-v' -v)ip 0 {-v')- (11) 


This detailed balance relation involves velocity inversion, 
and seems to be at variance with the condition Eq. ([9]) . 
The discrepancy is solved by making the crucial observa¬ 
tion that, for a collision describing heat exchange with an 
isotropic bath, there is an additional symmetry require¬ 
ment of invariance under reflection (and more generally 
under rotation mi ns]): 


k{v' v) = k(—v r —v). 


( 12 ) 


With this extra condition, the detailed balance relation 
Eq. (11) implies Eq. Q. 

Eq. (11) allows to make the consistent connection be¬ 


tween first and second laws: the entropy exchange S e can 
be rewritten (yjo(— v) = po(v)): 


S e = k B // dvdv'k[v' —¥ v)P(i 


,D ln^T = |, (13) 

ipo{v) T 


where Q is the rate of energy (heat) exchange from the 
bath to the particle, cf. Eqs. M ). The entropy pro¬ 
duction is zero if and only if k{v' —> v)P(v') = k{y — > 
v')P(v), implying that P(v)/P(v') = po(v)/po(v') and 
hence P(v) = Poi v )- We conclude that entropy produc¬ 
tion vanishes if and only if detailed balance is satisfied. 

We now show that both Eq. © and Eq. © are 
crucial to formulate the second law at the trajectory level. 
The stochastic entropy for the velocity variables reads [9j : 


s(t) = — k B lnP(v(t),t). 


(14) 


Note that this entropy still retains an ensemble charac¬ 
ter, as one needs to specify the probability distribution 
P(v,t), which is the probability to observe the particle 
with velocity v at time t starting from some specific ini¬ 
tial probability distribution. This so-called forward ex¬ 
periment is ran from initial time U to some final time tf. 
We now write: 


S — Si T s e , 


(15) 















3 


where the trajectory entropy exchange is the obvious ana¬ 


logue of the ensemble value given in Eq. (13): s e = q/T. 


The meaning of the trajectory entropy production is most 


easily clarified by integrating Eq. (15) over a finite time, 


leading to the finite difference balance: 

As = A js + A e s, 


(16) 


with A e s = q/T and q is the total amount of heat re¬ 
ceived (by collisions) from the heat bath in the realiza¬ 
tion under consideration. An elegant derivation of the 
celebrated fluctuation theorem for the trajectory entropy 
production proceeds with the consideration of the prob¬ 
ability for a trajectory in forward and reverse dynamics. 
We consider the simplest case of steady state operation, 
with the initial state of the forward experiment under ac¬ 
celeration a sampled from the steady state distribution 
P^(v). The reverse trajectory proceeds under the same 
acceleration a, starting with the final distribution of the 
forward probability, but with inverted speeds. Its prop¬ 
erties will be identified with a superscript tilde. Let -P(II) 
and P(n) denote the probabilities for a forward and re¬ 
verse trajectory, II and II, respectively. One now verifies 
the following striking equality: 


A ^ = ks In 


mi 

mY 


(17) 


The proof goes as follows. The probability of a trajec¬ 
tory involves the initial probability, the probability for 
not having collisions in-between the transitions, and the 
probability for transitions. Since the starting probability 
of the reverse dynamics is equal to the final probability of 
the direct dynamics, the log ratio of the initial probabil¬ 
ity contributions reproduces As = ks \nP(v(tf), tf) — 
ks \nP(v(ti),ti), cf. Eq. (14). Due to the detailed 


balance condition Eq. (11), the log ratio of probabil¬ 


ities for collisions in forward and backward dynamics, 


cf. \nk(v' 


])/k(—i 


-v') = \n(p 0 (v)/(po{v') = 


( v 2 — v ,2 )/(2 fc^T), reproduces — A e s = —q/T. Fi¬ 


nally, due to the reflection symmetry Eq. (12), the prob¬ 


ability for having no collisions, determined by the rates 
k(v' —> v) and k(—v' —► —v) when we have a velocity v' 
and —v', respectively, is the same in forward and back¬ 
ward trajectories. Hence the corresponding terms cancel 
out, and we have A,s = As — A e s as required. We con¬ 
clude that both at the ensemble level and at the trajec¬ 
tory level, the combination of detailed balance condition 
with the reflection symmetry are essential for a consistent 
stochastic thermodynamic interpretation. The implica¬ 
tions of Eq. © are well known 20 : the probability 
distributions P(A. ; s) and P(—A 4 s) for observing an en¬ 
tropy production A^s in the forward process and minus 
this value in the backward process obey a detailed fluc¬ 
tuation theorem: 


P(AiS ) 
P(- A,s) 


= exp(A,;s), 


(18) 


from which follows the integral fluctuation theorem: 
(exp(— Ais)) = 1 . A comment concerning the interpreta¬ 


tion of Eq. (18) is in place, for more details see psalm ED- 
[23]. In general — AjS is not the entropy production of the 
reverse trajectory. This will only be the case if the inverse 
“tilde” process is an involution, i.e., twice this operation 
is equal to the identity. In particular, the final proba¬ 
bility distribution of the reverse process should be equal 
to the initial distribution of the forward process. In the 
case of even variables, a sufficient condition is that the 
forward process starts and ends in a steady state. For 
odd variables, this condition is not sufficient as is illus¬ 
trated by the above example: the velocity inversion at 
the end of the forward process produces a probability 
distribution that is no longer at the steady state when 
a 7 ^ 0. There is however a simple procedure to cure 
this problem and to obtain a detailed fluctuation theo¬ 
rem which is, just like the integral fluctuation theorem, 
expressed solely in terms of a (slightly modified) forward 
process. At the end of the forward process, one performs 
an instantaneous switch of the probability distribution 
from P(v f ) to P(—Vf), implying and entropy change of 
A vi s = In P(vf)/P(—Vf). This is, on average (with re¬ 
spect to P(v f )), an irreversible entropy producing step. 
With this additional step, velocity inversion at the end 
of the forward will reproduce the steady state distribu¬ 
tion, which is also in the case considered here the initial 
distribution of the forward process. In conclusion the cor¬ 
rected entropy production A iS c = Ajs + A„s will obey 
a symmetric detailed fluctuation theorem: 


-P(AjSe) 

P(~\s c ) 


= exp (A,; 


(19) 


which can conveniently be verified by considering statis¬ 
tics of the forward experiment alone. 

To illustrate the above formalism, we focus on the sim¬ 
ple case of a “kangaroo” kinetic equation with a rate 

k(v' —y v ) [13] : 


k(v' —yv) = A (v')ip(v). 


( 20 ) 


One verifies that the detailed balance symmetry Eq. © 
implies in this case that the collision rate A = 1/r is 
a constant, independent of v', and hence k(v' —yv) = 
(po( v)/t. The reflection symmetry Eq. ( |T2| is, in this 
case, an automatic consequence of the detailed balance 


condition Eq. (11). Numerical simulations of the stochas¬ 
tic process Eq. (!]) allow us to compute the probabil¬ 
ity distribution P(AjS c ), see Fig. [l] and test the valid¬ 
ity of the fluctuation theorem, cf. Fig. [3] In the in¬ 
set of Fig. [l] we plot the large deviation function $ 4 (a:) 
that results of the fit P{8iS c ) ~ exp [—t$ t (<SjS c )], with 


t = tf — ti and SiS c = We have also considered the 
case X(v) = a|i>| whose corresponding results for P(A,s c ) 
are shown in Fig. [2] Interestingly, the reflection symme¬ 
try property is still satisfied, and the detailed fluctuation 
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Figure 1. Probability distribution P(A;s c ) (main plot) and 
large deviation function < f>t(a;) (inset) obtained from a nu¬ 
merical simulation of the stochastic process Eq. 0 for the 
case of a kangaroo reaction rate ( |20| ) with a uniform rate 
X(v) — 1/t, and operating under steady state conditions. We 
have taken t = 1, the acceleration a = 1 and a = 1 in (101. 
From left to right in the main plot the curves correspond to 
t = 1,10, 20, 50,100, 200. In the inset we see that $*(*) con¬ 
verges for large time to a time-independent curve, the large 
deviation function. The histograms have been obtained after 
averaging for 4 x 10 11 realizations. 


theorem is formally recovered. However the detailed bal¬ 
ance condition is violated. The steady state solution is 
not Maxwellian, and the interpretation of A iS c as ther¬ 
modynamic entropy production is false. 


We close with a few remarks. Stochastic thermody¬ 
namics has been developed in great detail for Langevin 
equations, see e.g. 121125, both in the over-damped and 
underdamped. A well documented case is a chain of 
harmonic oscillators in contact with two heat baths, see 
I25H28| . One may wonder why the symmetry property 
Eq. ( fll| ) has not been discussed in this context. By mak¬ 
ing the diffusion approximation on the master equation 
Q (29], one easily verifies that Eq. (11) requires that the 
drift term be uneven in the velocity and the noise term 
even. These conditions are met in a generic Langevin 
equation, explaining why this issue has not appeared in 
this context. The formalism presented above can be eas¬ 
ily extended to more complicated situations, such as mul¬ 
tiple particles with vectorial velocities in contact with 
several reservoirs of heat, particles or momentum and 
with time-dependent external forcing. Also the splitting 
of the entropy production in several components, such as 
the adiabatic and non-adiabatic contribution, proceeds 
as before l20l. 
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Figure 2. Similar to Fig. [T] for the case of a rate proportional 
to the absolute value of the velocity \(v) = a\v\ with a = 1. 
Same parameter values and time sequence as in Fig. |T| 


Pi- A..O 



Figure 3. Test of the fluctuation theorem including the data 
from the histograms of Figs. [T] and [2] 
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